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JITTER BUFFER AND METHODS FOR CONTROL OF SAME 

FIELD OF THE INVENTION 

The present invention relates to an audio receiver for use with 
communication networks and in particular to methods and apparatus for adjusting 
s a jitter buffer to an optimal size for playing audio, that has been transferred over 
unstable networks. 



BACKGROUND OF THE INVENTION 

Communication networke, such as wide area networks (WAN), are 
10 commonly known, and perhaps the fastest growing of these is tho Internet. One 
Internet application, known as multimedia transceiver, enables users to transmit 
and receive audio, video and data over the Internet. An example of this 
application, known as Internet telephony client, allows for telephone calls over the 
Internet 

is Audio may be transmitted in streams of packets over the Internet The 

Internet as well as other communication networks, ha6 regular jitter, defined in 
Schulzrinne, et al., "RTP: A Transport Protocol For Real- lime Applications", 
Network Working Group IETF, Request for Comments (RFC): 1889, January 
1996. available at http://www.ietf.org/rfc/rfc1889.brt, hereinafter referred to as 

20 "RFC 1889". Jitter for the Internet is tor example, 100 milliseconds. To 
compensate for this network jitter, the receivei typically includes a jitter buffer, that 
controls packet transmission rate. An exemplary jitter buffer is disclosed in 
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commonly assigned U.S. Patent No. 5,825,771, the disclosure of which is 
incorpoialed by reference in Its entirety herein. 

Fig. 1 is exemplary of jitter in a network, for example, the Internet In this 
Figure, jiller is shown as a line 20. Accordingly, the size of the jitter buffer may 
s be set to 30 milliseconds, to accommodate this jitter. 

Jitter buffer size is typically set in accordance with a bit rate of transferred 
audio packets. Changes in jiller buffer size effect audio quality, in particular, 
reducing j itter buffer size reduces delay of playing audio packets, but causes 
breaks in the audio transmission, when the amount of audio packets transmitted 
10 exce eds jilte i buffer size, Oppositely, increasing jitter buffer size helps to inhibit 
breaks in the audio, but increases delay. The balance between audio break-up 
and delay is easily established in stable networks. This is not so for unstable 

networks such as the Internet, that may have bursts, also known as burst periods 

'/ 

where large numbers of packets are transmitted in extremely short time 
15 segments, ae detailed in Fig. 2. These bursts result in spikes on a chart of 



network behavior, such as that detailed in Fig. 3, with the spikes occurring at lime 
intervals 3 and 8. 

Fig. 2 details an unstable network, such as the Internet, represented by the 
number of packets versus time (in milliseconds). Here, single packets of time 
20 length 10 are transmitted in equal intervals from transmission times 20, 40 and 
60. in a "normal" transmission. Between time 70 and time 170. there Is a silence 
peiiod. This silence period may be due to many factors, one common factor 
being that one of the routers along the packet transmission path is busy. As a 
result, a transmission of 7 packets, beginning at time 170. is immediately 
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followed, at time 180, by a transmission of five packets, followed immediately by 
single packet transmissions at times 190 and 200. I his rapid transmission of a 
large number of packets Is exemplary of a bunst, or burst period (between times ( 
170 and 210). Packet transmission returns to "normal" at time 220. 

5 Rg. 3 shows two bursts (bursl periods) graphically, along line 30 (formed of 

diamond shaped points) as spikes, occurring between time interval 2 and 4 and 
time interval /-y In this unstable network, exemplary of unstable networks, jitter 
buffer size, line 31 (formed of square shaped points) is continuously increased 
and reduced In size to keep the delay low, or alternately increase the delay, in 
id order to overcome a burst of packets. 

A major drawback to contemporary systems and methods for adjusting 
jitter buffer size is that these systems and methods do not distinguish between 
jitter and spikes, and thus, treat them similarly, When coupled with typical 
methods and systems thai adjust jitter buffer size, some packets never arrive at 
J 5 the receiver or arrive incompletely. This results in insufficient audio quality. 



SUMMARY OF THE INVENTION 

The present invention improves on the prior art jitter buffer control 
mechanisms by providing methods and apparatus for adjusting jitter buffer size of 
20 audio transceivers tor unstable networks. These methods involve estimating iittei 
buffer size based on the likelihood of a burst period by analyzing the receipt of 
network packets, with tho apparatus including hardware and software for 
performing the same. The present invention operates by distinguishing buret 
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periods from jitter, and adjusting the jitter buffer differently to accommodate these 
burst periods when compared to adjustments for jitter. 

The present invention is directed to a method for controlling jitter buffer 
size for a jiller buffer of a communication device for communication with a 
5 network. This method comprises the steps of monitoring the network for at least 
one burst period, where a large number of data packets or packets are 
transmitted rapidly, and then determining a likelihood for at least one subsequent I 
burst period from this at least one burst period. The jitter buffer size is then 
adjusted based on the likelihood of this subsequent burst period. 

10 ' The method, also includes measuring a time to play for each packet 
/ received at a predetermined location and building a time to play statistic by| 
\ creating at least two statistics from each of the received packets from at least } 
\ two predetermined time inter^als^Width^ 

from each of the at least two statistic, and from these calculated values, the 
is likelihood of the at least one subsequent burst can be determined. 

The present invention is also directed to an audio receiver for use with a 
network, such as the Internet, having a jitter buffer and a controller for i 
controlling jitter buffer size. The controller preferably includes a mj^processor 
or other similar computing means, programmed tojrionilor the network for at ' 
20 least one buret period and adjust the jitter buffer size (by signaling the jitter 
buffer) based on the monitoring of the network for at least one buret period, to 
accommodate packet transmissions in a burst period. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The piesenl invention will be described with reference to the 
accompanying drawings, wherein like reference numerals and/or characters 
identity corresponding or like components. In the drawings: 
5 Fig. 1 1s a chart of Jitter versus time in a communication network; 

Tig. 2 is a chart of number of packets versus time to Illustrate a burst or 
burst period; 

Fig. 3 is a chart detailing the operation of prior art jitter buffer control 
mechanisms and methods; 
io Fig. 4a is a diagram of an exemplary network environment of the 

present invention; 

Fig. 4b is a diagram of the terminal of the present invention; 
Fig. 5 is a flow chart detailing the method Of the present invention; 
Fig. 6 is a diagram useful in understanding the present invention and 
15 determining the Time To Play (TTP) for each packet; 

Fig. 7 is a Table of a TTP statistic in accordance with the present 

invention; 

Figs. 8 and 9 are charts detailing the operation of the jitter buffer and 
control mechanisms of the present invention as compared to those of the prior art; 
20 Fig. 10 is a table based on a TTP statistic for an Fxample of the present 

invention; and 

Hg. 11 is chart of jitter buffer size (in milliseconds) versus time (time 
intervals al which a TTP statistic was analyzed) comparing the present invention 
to the conventional art, for the Example of the Present Invention, 
25 There is also included Appendix A, a computer program. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

Referent*; is now made to Fig. 4a, which Is shows the environment tor 
the present Invention, i.e., a network 100, the Internet being an example of one 
such network. Within the network 100 are various routers (R) 102 and gateways 
5 (GW) 104. linked In a networked arrangement. Various communication devices, 
such as Internet Protocol (IP) terminals 1 10 die linked to the network 100 through 
gateways 104. Data packets, including audio packets, hereinafter "packets" travel 
over the network 100. 

Fig. 4b shows a receiver section 111 (or receiver) of an IP terminal 110 
10 in accordance with the present invention. This receiver 1 11 is pieferably an audio 
receiver, and includes a jitter buffer 112 linked to a speaker 114 or the like, via a 
decompressor 116 and an amplifier 118. The jitter buffer is also linked (by wired 
or wireless links 119a, 1 19b) lu a controller 120. that controls (adjusts) the size of 
the jitter buffer. 

15 The jitter butter 112 can be any conventional jitter buffer, for 

accommodating these packets, and for example, may be the jitter buffer detailed 
in U.S. Patent No. 5,825,771. The decompressor 116 and amplifier 1 18 may also 
be conventional devices. The speaker 114, can be a conventional speaker and 
can be one associated with a personal computer (PC) designed to handle 

20 telephonic applications. 

The controller 120, as detailed above, is prefeiably computer or 
microprocessor controlled. The controller 120 preferably includes, or alternately 
is linked to, a microprocessor (not Shown) or other similar computing or processor 
means, for running software, as well as performing olhei computing functions, so 

25 as to signal or otherwise control the controller 120, to properly adjust (increase or 
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decrease) or maintain the size of the jitter buffer 11?. Ifiere may also be a 
Gtorage unit for data and hardware associated with these microprocessor or other 
similar computing or processor means. 

The method of the present invention is performed as follows and may 
5 include software and additional hardware in addition to the hardware detailed 
above. This method i3 detailed in Fig. 5 in the form of a flow chart 

Initially, at step 200, the Time To Play (TIP) for each packet is 
measured. Here TTP is defined as the amount of time a packet (regardless of the 
number of frames contained therein) of any size will wait in the Jitter buffer 1 12 to 
to be played. TTP for packets is measured by monitoring the network (including 
monitoring for bursts or burst periods as detailed below), this monitoring typically 
performed by monitoring means (M) 122. including hardware, software or 
combinations thereof in the controller 120. For example, the monitoring means 
122 may include single or multiple samplers that monitor input to the receiver 111 
15 from the network along the arrow 123. 

Typically, the TTP for each of the packets Is determined when packets 
are received at any designated location. When a packet is received, it typically 
has a time stamp and a sequence number, as detailed in RFC 1880, at Chapter 5 
(including all of its subchapters), the entire RFC 1889 publication incorporated by 
20 reference in its entirety herein. TTP can then be measured as a function of the 
difference in times between timestamps of consecutively sequenced packets and 
the stamping frequency for the timestamp. 

Typically, each terminal 110, has a jitter buffer, to compensate and 
overcome jitter in the network. Fig. 6 is a diagram for measuring TTP for packets. 
25 shown as P1-P7. transmitted in an audio stream, using G 723 codec for audio 



P-2279-US 



15. MAR. 1999 18:48 EI TAN PEARL LATZER+ZEDEK .on989 P. 10 




compression, and decompression for each packet Each packet P1-P7, also 
includes a lime stamp (in accordance with that detailed above), shown on packet 
P1, for cxamplo, as indicated by the circle labeled TS, that for packet P1 is 0. 
Similarly, packet P2 has a timestamp of 240 (indicated by the circle labeled TS), 
5 etc. Initially, at time 0 ms packets arrive (arrival indicated hy the curved arrow AA) 
at the terminal 110, but are not played directly. Rattier, they are delayed In the 
jitter buffer 112 (Figs. 1 and 2) in order to build the jitter buffer (building starting at 
time 0 ms). 

Starting at time 60 ms, the approximate time when the jitter buffer has 
10 been built, packets begin to leave the jitter buffer at constant speed. Accordingly, 
at every 30 ms interval (30 ms is G723 codeo frame size), the next packet leaves 
the jitter buffer. Once a packer leaves the jitter buffer, and is received at a 
reference point along the audio slream, the packet size may be estimated. Size 
of packets is estimated based on knowing that G. 723 codec has an 8000 He 
15 sampling rate, such that the size of a packet (Pn) is estimated by the following 
equation: 

Pn«(TSp n +i-TSpn)/CSR (1) 

where, 

TSph + 1 is the timestamp of the subsequent packet; 
20 TS H n ie the timestamp of the packel for which measurement is desired; and 
CSR is the codec sampling rate (here 8000 I Iz). 

Fmploying this equation, P1 packet size is (240-0)/8000 or 30 ms I Iz, 
P2 is 30 ms, etc. Identical calculations may be made tor succeeding packets, 
whereby succeeding packets P3-P7, in this example are 30 ms in size. 
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With packet size known, and continuing to refer to Fig. 6, time to play 
(TTP) for each packet can be calculated. As shown in this diagram, packets 
leave the jitter buffer every 30 ms, after time 60 ms (packets leaving being 
indicated by the arrows PL). Specifically, packet P1, with o time stamp of 0 me 
5 leaves the jitter butter and Is played at time 60 ms, packet P2, with a time stamp 
of 240 ms leaves the jitter buffer and Is played at time 90 ms, P3, with a time 
stamp of 480 ms leaves the jitter buffer and is played at time 120 ms, packet P4, 
with a time stamp of 720 ms leaves the jitter buffer and is played at time 160 ms, 
packet P5, with a time stamp of 960 ms leaves the jitter buffer and is played at 

to time 180 ms, packet P6, with a time stamp of 1200 ms leaves the jitter buffer and 
is played at time 210 ms, and packet P7, with a time stamp of 1440 ms leaves the 
jitter buffer and is played at time 240 ms. 

In determining TTP for each packet, the time stamps of the first played 
packet are subtracted from the time stamp of the newly arrived packet. This result 

is is then divided by the G.723 codec sampling rate (8000 Hz). TTP for each packet 
(TTP) is expressed by the equation: 



where, 

TSna is the timestamp of the newly arrived packet; 
20 TSpp is the timestamp of the first to play packet; and 
CSR is the codec sampling rate. 

For example, beginning with packet P4, newly arriving at or shortly after 
time 60 ms, TS PA is 720 ms (time stamp of P4), TSrp is 240 ms (timestamp of 
first to play packet-Packet P2, at lime 90 ms-the set time) and CSR is 8000, the 



TTP = (TSna - TSfp)/ CSR 



(2) 



9 



P-227EMJS 



15.MflR.1999 18:49 EITflN PEftPL LATZER+ZEEiEK .on989 P. 12 

G.723 codec sampling rate. Thus, the TTP tor packet P4 in accordance with the 
equation above is (720 ms - 240 ms)/8000 or 0.06 seconds or 60 ms. 

Packets P5 (timestamp of 960 ms) and P6 (timestamp of 1200 ms) 
arrive at or just after time 120 ms (at this time P4-time stamp of 720 ms, is the first 

5 to play packet), such that TTP for P5 is (960-720J/8000, or 30 ms, and TTP for Pfi 
is (1200 ms - 720 ins)/8000 or 60 ms. In Ihe case of Packets P5 and P6, lhat 
arrive at the camo timo, their order could be switched, and if so, their TTP's would 
not be effected by their different arrival order. Similarly, packet P7, with a 
timestamp of 1440 ms. arrives sometime after time 210 ms, and at set time 240 

10 ms, TTP for P7 is (1440 ms - 1440 ms)/0000 is 0 ms. 

This information can then be used in building a TTP statistic, at block 
202 of Fig. ft. Spftrifically, data corresponding to the time interval between time 
60 ms and 240 ms foi Ihe TTP statistic is as follows: 



TTP 


-30 


0 


30 


60 


90 


No. Of Packets 


0 


1 


1 


2 


0 



15 In accordance with this TTP statistic, one packet P7 had a TTP of 0 ms, one 
packet P5 had a TTP of 30 ms, two packets P4 and P6 both had a TTP of 60 ms, 
and zero packets had a TTP of 90 ms. Negative TTP's (here -30 ms) is assigned 
to late arriving packets (in the jitter buffer). These packets 3re not played in the 
jitter buffer, but the information provided with each late arriving packet is 

20 preferably used for increasing jilter buffer size. 

These lines (each a TTP statistic) are then built in to a TTP statistic over 
a time period. Fig. / Khnws a table that is an actual experimentally determined 
TTP statistic in accordance with the present invention. The number of packets 
having certain TTP'e was evaluated at various intervals, time 0, the 074 ms after 
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time 0, then 1627 ms later (than time 874 ms), then 3247 later (than time 874 ms 
+ time 1627 ms). etc. This TTP statistic is stored in microprocessor memory or 
other similar memory or storage device (or unit) in the terminal 110, preferably in 
the controller 120, or external thereto. 



^vidth" and an "offset". The Width its the differ enoe between the largest TTP and 
the smallest TTP, end the Offset is the lowest TTP where a packet was received. 
For example, for line "1" (or Histogram #1), the Width is 60 ms; calculated from 90 
(5 packets received with TTP of 90 ms) minus 30 (5 packets received with TTP 30 

10 ms) and the Offset is 30 ms, TTP 30 ms being the lowest TTP where a packers), 
(here 5 packets) were received. 

With the IIP statistic built, this statistic is analyzed to determine if there 
is a burst (buret period) in block 204. The determination of the burst or burst 
period is determined by an analysis of the TTP statistic as bursts or burst periods 

is are functions of above detailed offset and width values. 

For example, in the TTP statistic of Fig. 7, lines "12" and "13" 
(Histogram #s 12 and 13) are indicative of a burst as the difference in width \ 
between lines 12 and 13 is 300 (480-Iinc 13 minus 180-line 12), this width change \ 
being greater than approximately 200. Moreover, this burst or burst period is also 

20 indicated from lines M 13" and "14 M (Hystogram # 13 and 14) where the offsets 
have shifted by approximately 200 or greater (to the right). Specifically the offset j 
has gone from -120 (line 13) to 240 (line 14). 

Once there has been a burst, the likelihood of a subsequent burst is 
calculated from the TTP statistic at block 206. The likelihood of a subsequent 

25 burst is also function of the Offset and Width values (detailed obovc) from the 
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Additionally, from this TTP statistic, ear* line has values known as a 
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TTP statistic. Generally, the likelihood of a subsequent hurst, Increases with each 
burst. I he actual analysis for determining the buret or burst period likelihood, is a 
statistical analysis, in accordance with that detailed in Appendix A below. 

With the likelihood of a subsequent burst or bursts calculated, in block 
5 206, the jitter buffer size can be estimated, in block 208, based on this likelihood. 
The estimated Jitter buffer size is determined from a statistical analysis, in 
accordance with that detailed in Appendix A below. This estimated jitter buffer 
size and present jitter buffer size, as measured (above) are compared at block 
210 (change in size). 

10 |f a change in size is to be made, either increasing or decreasing the 

jitter buffer, at block 212, the controller 120 signals the jitter buffer, that has the 
corresponding hardware to increase or decrease its size in accordance with the 
signal from the controller. With the jitter buffer adjusted, the system returns to 
block 200 to start again. This method can be repeated for as many time intervale 

15 as desired. 

Fig. 8 shows jitter buffer aba being adjusted in accordance with the 
p resen t invention in view of network behavior. Line 30 (formed of diamond 
shaped points) represents the present invention, and line 31 (formed of square 
shaped points) represents the prior art jitter buffer size adjustment methods, both 

*o aa detailed in Fig. 3 above. Here, a first burst or burst period has been detected, 
at lime interval 3. Based on the method detailed above, the likelihood of a 
second burst has been determined as low. However, at time interval 8, a second 
burst has bean detected, and now, in accordance with the method of the 
invention. Ih e likelihoo djor a subsequent burst or burst period Js high. Between 

25 time intervals 3 and 8 the jitter buffer of the invention, indicated by line 233 formed 
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by triangular shaped points, is adjusted so as to decrease jitter buffer size at a 
substantially constat il idle, until the next, here the second, burst or burst period. 
This behavior is similar to that of the prior art, in line 31. 

After the second burst at time interval 8, the likelihood of a subsequent 
s burst or burst period is highly probable. In accordance with the present invention, 
the jitter buffer is then kept at the level of the burst or burst period that it was 
raised to, in order to accommodate the anticipated burst or burst period, as shown 
by line segment ?33a between time intervals 8-11. By remaining at this level, the 
iillei buffer can accommodate subsequent bursts or burst periods. This ie in 
10 contrast to the prior art, that again, rises for the burst and then drops immediately 
at a substantially constant rate (lino segment 31a). This immediate drop, serves 
to immediately decrease jitter buffer size as the prior art can not differentiate 
between bursts and jitter, and thus, treats all events as jitter. As a result of this 
failure to keep the jitter buffer at a size larye enough to accommodatA the 
is subsequent burst or burst periods, the audio transmission experiences substantial 
bieaks. 

If a change In size is not made, the Jitter buffer is not adjusted, at block 
214, and the system returns to block 200 to start again. This is detailed in Fig. 9. 
where a lonely burst in the network (line 30), shown graphically by a spike at time 

20 interval 5, has been detected. With the probability of a second or subsequent 
burst being low, the jitter buffer size, represented by line 233'. formed ot triangular 
shaped points, remains the same. Although some audio is lost as a result of the 
burst, mere is riot any reason to raise the jitter buffer since, in accordance with the 
TTP statistic (detailed above) a subsequent bust or burst period has been 

as determined to be unlikely. This is different than the prior ait, shown by line 31' 
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(eimilarto line 31 detailed above), where the burst or buret period (indicated by 
the spike) is treated like jitter and thus the buffer automatically adjusts, and Is 
forced to he larger than necessary, between time intervals 6-11. such that audio 
transmission is delayed, 
s The above detailed steps." Indicated at blocks 204 214 may be 

performed by an algorithm, Identical or similar to that of Append!* A. below. This 
algorithm could be implemented by software, hardware, or combinations of both 
in the terminal 1 10, with the computing devices provided therein. 
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Example%iitter Buffer Calculation and Adjustment 
This Example makes reference to Figs. 10 and 11 and the Algorithm ot 
Appendix A, listed as a computer program, for implementation by software. In this 
example, the present invention was -analyzed against prior art jitter buffers and 
methods for their control from "FTP statistics (indicated by TTP statistic # or time 
15 interval no., col. 1 of Fig. 10), each TTP statistic taken at an increasing time 
interval (this time interval in milliseconds). Ihe results were plotted graphically in 
Fig. 11, with the present invention formed of diamond shaped points, each point 
corresponding to a TTK statistic # (col. 1 of Tig. 10) and the line formed from 
these points indicated by the number 400, and the conventional jitter buffer 
20 adjustment technique, formed of square shaped points, each point corresponding 
to a TTP Statistic # and the line formed from these points Indicated by the number 
401. The values determined in the table of Fig. 10, were obtained by the 
algorithm detailed in Appendix A. 

At TT p statistic # 8, o first burst or bu.st period has been detected. This 
25 causes the bu.st likelihood to increase to 0.25. This is in contrast to the 
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conventional art jitter buffer and control methods therefor, where the jitter buffer is 
set according to the last (most recent) measurement, resulting in an increased 
delay. With the present invention, tho jitter buffer grows sliyhtiy from this point, 
but remains relatively low, since here, the buret likelihood for a subsequent burst 
5 ie still low, whereby delay remains low. 

A second buret Is detected at TTP Statistic #13. increasing the burst 
likelihood to 0.4. At this TTP statistic, the Burst2AbsolutCoff (from Appendix A 
and the definitions piuvided above) (Fig. 10, col. 8) grows to 1. A third burst is 
detected at TTP Statistic # 22, and after this third hurst, the Burst2AbeoutCoff 
10 remains 1 tor a substantial time' (to TTP Statistic #34). When the 
Durst2Absoutcoff Is "1" and considered to be "high", jitter buffer size is adjusted 
according to the burst size. The adjustments made grow the jitter buffer to 1080 
ms at ITP Statistic 13, and the jitter buffer remains at this sire until larger burets 
result in jitter buffer growth to 1020 ms, corresponding to TTP Statistic # 22. 
i* At Time 22 on the graph (Fig. 1 1), corresponding to TTP Statistic # 22. 

the difference between the invention, line 400 and the conventional art. line 401 is 
noticeable. In the conventional art. the jitter buffer is reduced after the spike, 
since there are not any additional spikes until Time 39 (corresponding to TTP 
Statistic # 39). In accordance with the present invention, as detailed above and 
20 Appendix A, jitter buffer size is not reduced, since the burst likelihood ie still high, 
and remains high to about Time 43 (corresponding lo TTP Statistic # 43). 
Moreover, the burst al TTP Statistic # 39 causes little, if any, audio degradation. 

With the last large burst occurring at Time 39. subsequent bursts are 
decreasing^ smaller. At Time 39 there is a last large bust, which the 
25 conventional art method can not adjust for, and thus causes audio degradation. 
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This Is in corrf/ast to the present invention, that adjusts the jitter buffer to 
accommodate subsequent burets or burst periods, and substantially reduces 
audio quality degradation. As the burst or burst periods decrease, the present 
invention and conventional art behave similarly. 

While preferred embodiments of the present invention have been 
described so as to enable one of skill in the art to practice the present invention, 
the preceding description is exemplary only, and should not be used to limit the 
scope of the invention. The scope of the invention should be determined by the 
following claims. 
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